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, We describe generalized Brownian motion related to parabolic equa- 

tion systems from a logical point of view, i.e., as a generalization of An- 
I derson's random walk. The connection to classical spaces is based on the 

Loeb measure. It seems that the construction of Roux in [11] is the only 
attempt in the literature to define generalized Brownian motion related to 
I parabolic systems with coupled second order terms, where Lame's equa- 

■ tion of elastic mechanics is considered as an example. In this paper we 

provide an exact construction from a logical point of view in a more gen- 
eral situation. A Feynman-Kac formula for generalized Brownian motion 
is derived which is a useful tool in order to design probabilistic algorithms 
for Cauchy problems and initial-boundary value (of a class of) parabolic 
systems as well as for stationary boundary problems of (a class of) elliptic 
equation systems. The article includes a selfcontained introduction into 
all tools of nonstandard analysis needed, and which can be read with a 
minimum knowledge of logic in order to make the results available to a 
wider audience. 
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1 Introduction 

Parabolic systems of equations are ubiquitous in sciences: they describe fields 
in physics and mechanics such as displacement fields of solids in elasticity, are 
' used for modelling reaction-diffusion in chemical and biological processes, and 

even in mathematical finance certain systems with interacting Ito and point pro- 
cesses are related to parabolic systems and therefore beyond the realm of scalar 
equations (cL [3]). On the other hand, although the powerful concept of Brow- 
nian motion entered many branches of physics, finance, and engineering such 
as heat transfer, dispersion (cf. Einstein, [4]), electrostatics and equity markets 
(Bachelier, [1]), information theory and noise (Shannon, [13], Brillouin, [2]), and 
quantum mechanics (Nelson). However, except for some work related to fluid 
mechanics (probabilistic approaches to the Navier-Stokes equations based on 
Malliavin calculus such as in Mattingly) and more abstract articles related to 
parabolic systems with coupling of lower order terms it seems that the work of 
Roux is the only attempt to construct a generalized Brownian motion related 
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to parabolic systems with coupled terms (such as Lame's equation) of second 
order in the sense that certain expectations of functions of generalized processes 
solves Cauchy problems of a certain class of parabolic systems (to start with). 
It seems that the construction of Roux in [11] is the only published attempt 
in this direction. However, it is clear that this construction is not in an exact 
measure theoretical sense. This may be a parallel to the situation of the clas- 
sical Brownian motion where Winer's construction of Wiener in 1923 was the 
first exact functional analytic description of Brownian motion after it has been 
introduced as a mathematical object on a more heuristic level by Bachelier and 
Einstein a long time before. However, it is not even clear on a heuristic level 
whether the construction of Roux really works (in this context we may say that 
a construction is 'correct on a heuristic level' if it leads to an algorithmic scheme 
(a Monte-Carlo method) where there is (at least) experimental evidence of con- 
vergence in a probabilistic sense. Well it seems by no means clear whether the 
Landau remainder terms in equations (29) and (30) in [11] become small as the 
time step size of the scheme becomes small. In this paper we describe a different 
approach to the problem stated. It is based on a generalized 6 function corre- 
sponding to stochastic processes on the n-dimensional torus T" = S*^ x • • • x 5^ 
(note that the ^-function on the circle is the analogue of the fundamental 
solution on M). It seems easier to construct generalized Brownian motions in the 
context of non-standard analysis. Since this theory is not that well-known this 
article provides a self-contained introduction to the subject including elemen- 
tary stochastic analysis such as non-standard definitions of stochastic integrals, 
non-standard densities and Ito formulas. The theory is quite appealing in this 
respect since proofs are easier once the framework is established. Moreover, a 
very modest knowledge of logic is required to follow our introduction into the 
subject. Note that the non-standard theory used here is a consequence of the 
Zermelo-Frankel theory together with the axiom of choice (so-called ZFC). We 
do not need additional assumptions. Other theories with explicit infinitesimals 
may be used, for example topoi used in the conext of synthetic differential geom- 
etry or Connes functional analytic theory (called non-commutative geometry), 
where compact operators play the role of infinitesimals. In any case we may 
interpret the part of nonstandard analysis as a part of ZFC-theory, although 
heavy use of the axiom of choice maybe against the taste of some advocates of 
classical descriptions. From a logical point of view this taste does not matter 
as does Connes remark that dart play may be better described by his theory 
(without proof). Similar as intuitionist mathematics nonstandard theory has 
been criticised to be not productive. In the latter case this criticism is stated 
in the sense that nonstandard analysis does not lead to results which do not 
have their classical counterparts. Adherents to this view are asked to give a 
classical counterpart to the construction of generalized Brownian motion and 
Feynman-Kac formula described in this paper. We close this first section with a 
description of the problem of generalized Brownian motion related to parabolic 
systems in a classical context. The parabolic equation systems considered in 
this paper the quadratic form 
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(We use the quadratic form for simplicity). Here, 

u= (ui,--- ,u„)^ (2) 
is a vector- valued function where for each x £ R" and each 1 < i,j < n 

I al^{x) ■ ■ ■ alJ^x) 



X -)■ {x) 



(3) 



V al^{x)---a'l,(x) 



may be assumed to be bounded C°° . Similarly x -> B^x),j = 1, • • • ,n and 
X — >■ C{x) may be assumed to be a n x n-matrix-valued function respectively 
with bounded C°°-cntrics. If certain ellipticity conditions are satisfied then 
equations of the form (1) are called parabolic. Such conditions can be found in 
many classical textbooks such as ([6]). In analogy to the construction of classical 
Brownian motion our construction of generalized Brownian motion is in relation 
to equation with constant coefficients. The generalization to processes related 
to parabolic systems is quite straightforward. So let us assume for a moment 
that aj^iix) = a^-'j. What we need for our construction is global existence and 
the requirement that for all 1 < i,j < n the matrices 

A^^iA:^):^(^a%a,a}j (4) 

are strictly elliptic for all a where all a,; 7^ 0. 

Now in the case of scalar equations there is a natural correspondence between 
solutions of certain parabolic Cauchy problems and stochastic diffusion pro- 
cesses. We may put it this way: the fundamental solution of a scalar parabolic 
equation of type 

at ~ ^id=l dx.dxj Z^i=l dx, y'^) 

equals the transition density of a diffusion process of the form 

n n 

dXt - J2 ^''^^ + ^^j^^j ' 

where W — {Wi, ■ ■ ■ , Wn) is a standard Brownian motion, and 

{aij)=aa^. (7) 

A decomposition as in (7) exists if a certain regularity requirement is satisfied. 
More precisely the fundamental solution of (5) is the solution of the family of 
Cauchy problems 

dp_spn d'^p I , dp 

dt ~ ^i,j=l y dx,dx, ~^ 1^1=1 dxi 

(8) 

p{0,x,y) = 6y{x), 

where for each y € M" ^y{x) = 5{y — x) along with the Dirac delta distribution 
i5. On the other hand, if for each x E M" the stochastic differential equation 
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(6) with initial data Xq = x has a strong solution X = (-'^f )o<t<oo which is 
associated with the Markov family (X, fJ, J" = (-7^)o<t<oo jP'^)x£ts.", then the 
density p should satisfy 

P'-'iX^ edy)^p{t,x,y)dy. (9) 

For example, the transition density related to the the family of Brownian mo- 
tions {W^)x^]s." is the fundamental solution of the heat equation. This rela- 
tionship between stochastic processes and partial differential equations is quite 
useful as it provides us with probabilistic algorithm for the solution of Cauchy 
problems and boundary value problems. Moreover, analytic approximations of 
densities can be used in order to improve such probabilistic schemes (cf. ([7])). 
Our question is: Is there a analogous relationship for parabolic systems? Note 
that there are construction of fundamental solutions for parabolic systems such 
as (1) by the parametrix method. How does a stochastic process look like which 
satisfies a relation analogous to (9)? It seems that the paper of Roux (cf. [11]) 
is the only paper which has posed this question. However, as we have said, 
it seems that the definition given there needs some mathematical clarification 
since the Landau terms in equations (29) and equation (30) are not estimated. 
Maybe the situation is similar as with Bachelier's and Einstein's early work on 
Brownian motion. Here the work of Wiener in [14] provided the first exact de- 
scription of the Wiener measure. The heat equation related to Brownian motion 
has constant second order coefficients. Hence, similar as in the scalar case we 
may consider parabolic systems with constant coefficients. Well the probabilis- 
tic interpretation of the fundamental solution is far less obvious. However, it is 
a start. As an example, let us consider Lame's equation describing displacement 
fields in elasticity. In its time- dependent version it is 

If = [l-i.(n-l)]V2v + V[V-v], (10) 

and a typical problem is to solve it in some bounded domain D = {0,T) x 
with ft C K", and where 

v{t,x) = B{x) for aU x e dpD 

(11) 

v(0,a;) = A{x) for all x <E il. 

Here, dpD is the parabolic boundary of D and the initial and boundary condition 
fields A and B will satisfy some compatibility conditions. In coordinates (10) 
reads (we use Einstein summation) 

T^^EJ[^-Hn-l)]v^.n+v,,,^ (12) 

and in case of dimension n = 2 we see, with a = [1 — iy{n — 1)] wc have the 
representation 
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In this case our ellipticity assumption (4) amounts to the assumption that for 
all multiindices a £ 77^ the matrix 

a\{a + l) + aa\ aia2 \ 

aia2 aal + {a + l)alj 

is strictly elliptic (which is certainly true for a > 0). Note that this example is 
of the form (1) along with B = and C = (where denotes a matrix with 
zero entries in the former case and a vector with zero entries in the latter case. 
It is natural to define generalized Brownian motions to be processes which are 
related to the latter class of parabolic systems. Note that in elasticity stationary 
problems of the form 

[1 - i^(n - 1)] V^v + V [V • v] = in r2 

(15) 

V = g for all X £ d^l, 

are of special interest. Here ft C M" is some open domain. The probabilistic 
representation in terms of expectations with stopping times (first exit time) is 
quite appealing (also from a algorithmic point of view). In any case, the question 
is whether we find a a family of processes, say B"^'^ (where A encodes the 
information of constant coefficients aj^i of the diffusion) , such that for D = M" 
the function 

{t,x)^E^[F{{,Bf-^)), (16) 

where F is a rather simple functional with values in W\ We shall define Bf'^ 
as an infinite vector of n by n matrices. Then F will be just the infinite sum 
over all multiindices a of products of each n by n matrix entry of Bf'^ with 
the vector entries of the infinite vector of vectors of the form 

I ^ f io. exp (i27rax) j (17) 

encoding the information of the initial data f . Here, fia is the ath Fourier 
coefficient vector of the zth component fi of the vector-valued function f and 
Bi denotes the zth unit basis vector of R" (cf. next section for more details of 
this definition). Although it seems possible do to the construction in a classical 
framework of Wiener measures the nonstandard construction seems to be easier 
in this context. The connection to standard spaces is via the Loeb measure. 
Therefore, in the next section we shall introduce Anderson's random walk and 
the Loeb measure and make a precise definition of the generalized Brownian 
motion. 



2 Anderson random walk and generalized An- 
derson random walk 

The following construction may be put into a more classical framework, but the 
formulation seems more simple to me in the nonstandard framework. This is a 
matter of taste to some extent. In any case, from a logical point of view, we 
are working in ZFC. Moreover, we shall project to classical space finally The 



5 



transition from nonstandard probability spaces to standard probability is via the 
Loeb measure. Let us recall the idea of the Loeb measure first (Readers with 
no background in nonstandard analysis are advised to read our selfcontained 
introduction into the subject starting with the next section first). Let H be an 
hyperfinite, and let Pi{H) be the set of all internal subset of H . Define 

^l■.PI{H)^[Q,l]* 

(18) 

where |.| denotes the cardinality of a hyperfinite set. The values of ^ are in 
[0, 1]* because subsets of a hyperfinite set H have a smaller internal cardinality 
than H . Loeb observed that the map 

A^L :P/(i/)^ [0,1] 

(19) 

A.L(5) = sh(^), 

is a measure, i.e., the map /i^ satisfies the countable additivity axiom. This is 
due to the fact that a family (S'i)igN of mutually disjoint elements Si E Pi{H) 
with 

S UeN^» e Pi{H) (20) 

is a finite actually, i.e. 

5 = 5i U • • • U 5fc (21) 

for some fc g N (otherwise S would be external). Next let us recall the main 
theorem concerning the Loeb measure. Let (J7,^, P) be an internal, finitely 
additive probability space, i.e. 

i) 17 internal 

ii) A is internal subalgebra of V{Vt) 

iii) P : ^ *M is an internal function such that 

iv) P (0) = 0, P (f7) = 1, V A, P : P{A U B) = P{A) + P{B) - P{A n B). 

The following theorem is the main theorem of non standard probability theory. 

Theorem 1. There is a standard (a-additive) probability space (fi, Al, Pl) such 
that 

i) Al is a a-algebra with A C Al ^ Pi^) 
ii) Pl =° P on a 

iii) For every A €z Al and standard e > there are Ai and Ao in A such that 
At C Ac Ao and P {Ao \ Aj) < e 

iv) For every A e Al there is B e A such that Pl (AAB) = 
The space (JI,Al,Pl) is called a Loeb probability space 
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In order to introduce stochastic processes we consider hyperfinitc timelines 



T^{0,h,t2,--- ,tN}, (22) 

where N is an infinite integer and ti^i^ti are infinitesimal for alH S {1, 2, • • • , N}. 
In the following we assume that we have At — i^+i — ti for all i e {1, ■ ■ • , N}, 
i.e., the discretization is uniform. An internal stochastic process is an internal 
map 

X -.T xn^*R. (23) 

We may assume that it is adapted to a certain filtration of the Loeb algebra. 
We may then model Anderson's random walk (the nonstandard counterpart of 
Brownian motion) as an internal map 

B : T X n ^ *R 

(24) 

where we may model 

n = {uj : T ^ {-l,l}}\uj is internal} (25) 

It is clear how the associated probability measure and the Loeb filtration looks 
like in this case. It is well known that standard Brownian motion is just the 
shadow of this process, i.e., we may define 

M^(t,w) = °S(t",w), (26) 

where is just the largest element in T smaller or equal to t. Note that in (26) 
we defined the Brownian motion just in case of dimension n = 1. Generalization 
to higher dimension is straightforward, and we do not indicate the dimension 
when we use the symbol W in the following. As usual processes are often written 
as families of random variables in the form Wt or Xt with the subscript t, and we 
adopt this convention. It will be clear from the context or irrelevant. This may 
be the most simple exact definition of a Brownian motion available. Note that 
Levy's theorem can be proved quite easily in this framework. We may construct 
more complicated processes from this easily, and we shall consider more general 
internal martingales later, but for the moment let us look at the Feynman-Kac 
formula in a very simple form. Consider the solution of the Cauchy problem on 
[0,oo) X R" 

dt 

(27) 

"(0,.) = /, 

where / G H"^ (R") for arbitrary s G M (where i?^ is the usual Sobolev Hilbert 
space)- especially this means that / is smooth and decays rather rapidly at 
infinity. We know that u has the representation 

u{t,x)=E^f{Wt)). (28) 

where is the expectation and the superscript x indicates that we let start the 
Brownian motion at a; G R". Similarly, if ti : C M" — ?• K solves the equation 

E;=i0=/onf^, (29) 
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then V has the representation 



u{t,x)=E^f{Wr,,)), (30) 

where denotes the first exit time from the domain fl. Similarly, in order to 
define a Wiener measure on the n-torus T" we may consider the fundamental 
solution 6 of the problem with periodic boundary conditions 

du _ y^n d'^u 

(31) 

?i(0, .) = /, u{t, X + ei) = u{t, x) for all 1 < i < n, 

where denotes the ith vector of the standard basis of M". This 6*- function is 
given for t > hy 

6»(i, cc) = ^ exp (27riaa; - 47ra^i) (32) 

where the sum is over all multiindices a = (ai,--- ,a„) with entries ai in 
the integers Z. Note that for 9{t, .) converges in distributive sense to the S- 
distribution as i J, 0. Accordingly, 

uit,x) - / f{y)e{t,x-y)dy. (33) 

Similar formulas hold for n-tori of any radius R of course, and we may 
define associated Wiener measure W'^R in the usual manner. As i? t 00 we get 
the standard Wiener measure. For elliptic problems such as (29) on bounded 
domains VL we find equivalent representation of the form (34) or of the form 

v{t,x) = E-{^f{wJh), (34) 

for R large enough. We shall consider measure which are defined on the n-torus. 
They are easily defined in the framework of nonstandard analysis and they lead 
to a description of generalized Brownian motion as we point out next. From 
the point of view of nonstandard analysis we may consider the functions u, / to 
be standard parts of internal functions which we denote with the same symbols 
u and / for the sake of simplicity of notation. Let the time t be the standard 
part of a time tM € T. If we observe the process B^, i.e., the Anderson random 
walk starting at x, up to time t^f, then we know the value of w(s) up to time t 
and we nothing about cj for s > t. Wc may consider the equivalence classes 

a; ~ cj iff Vs < f : uj{s) = uj{s), (35) 

and denote the corresponding equivalence classes by [ojjt- We define 

nM = {MtJi^en} (36) 

and 

P„ : Qm ^ [0, 1] 

(37) 

-Pn(HtM) = 2^ fol' all [0j]tM e ^M- 
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Furthermore let us define the random variable 



(38) 

i3L(Ht..):=.T + Es<t^(«)VAf, 

where w is some internal function with lj G [^jj\tM (this is well defined since we get 
the same result for all w € [w]tA/ by definition of the equivalence relation \\tM)- 
Next we consider a hyperfinite discretization of *]R. Let Ax be an infinitesimal 
hypcrrcal number and define 

*Max := {fcA.T|fc e* Z}, (39) 

where *Z denotes the set of hyperintegers. 

This discretization has the advantage that values of integrals in classical 
calculus are the standard parts of hyperfinite sums. Then we may introduce the 
density function p defined on T x * Rat x * by 

p{tM,x,y):^ ^ 5y{Bl^{[u:]t,,))P{[u:]t,,), (40) 
where for each ye* Max 

( 1 iff z = 2/ 

5y{z) := <^ (41) 
[ Oiffz^y 

denotes a hyperfinite Kronecker delta translated by y. Note the difference to 
classical calculus where the density is defined by a Cauchy problem with a delta 
distribution as initial data. The standard part of the function p can be computed 
as a limit similar as in the nonstandard proof of the central limit theorem below. 
Furthermore, the internal function u has a representation 

u{tM,x)=Y. E f{y)5y{Bl^{M,,,))P{\^],,,), (42) 

and this representation may be used to get another proof of the Feynman- 
Kac formula. These representations of the density p and the value function 
u motivate analogous definitions in the context of the linear parabolic systems 
considered in the introduction. In order to do this we first consider an Anderson 
random walk in dimension n. We define 

nn = {uj:T ^ {-1, 1}" \uj internal } , (43) 

and define 

B -.T xQn^* K" 

where uJi is the ith component of the function lo, and is the ith element 
of the standard basis in *W\ Next for any positive matrix A we consider its 
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representation A = QAQ^ with A = diag(Ai) the diagonal matrix with diagonal 
entries Ai > and define 



-.Txnn^* M" (g)* K" 

(45) 



with the Kroneckcr (5-function dij (the subscript ij indicates that the entry of 
the ith row and the jth clumn is defined). Furthermore, we define 

BA(i,w) = gB^(t,w)Q^ (46) 

Generalized Brownian motions related to linear parabolic systems will be de- 
fined by an infinite vector of such matrix- valued Anderson random walks, where 
each entry encodes information of the diffusion coefficients a'^i . The generalized 
Brownian motion we are going to construct can be represented by an infinite 
vector of n by n matrices. This may be described analogously to the so-called 
Kronecker description of tensor products but we do not go into this. For some 
total ordering of multiindices a S Z" we may interpret B^n = (Bq,)^^^'' to be 
some infinite vector of n by n matrices matrices with entries in the complex 
numbers C and V^n = (vq)^^^" some infinite vector of n-dimensional vectors 
with entries in the complex numbers. Then we define 

(Bz.,Vz.) :=;^B„C„. (47) 

Moreover, the components of the product are denoted by 

(Bz.,Vz.), :=^(i?aC„),, (48) 

and where {BaCa)^ denotes the ith entry of the vector B^Ca- Let = {A]^) := 
(Sfci '^ki^''^^(^kcti^ ■ Then for Aa = Qa^^aQa diagonal Aq, with positive 
entries Ai > and orthogonal Q define (with Ax = \/Ai 

B^ : T X ^* ®* 

(49) 

[B^it,u))^^ = E^li (E.<t^.(s)VAi) 

where Sij denotes the classical Kronecker delta, and for a positive definite matrix 
A with decomposition QAQ^ and A = diag(Ai) define 

: T X f7„ ^* Rl.^ (g)* R2,x 

(50) 

B^it.w) := QB^"'\t,uj)Q'^ . 
A crucial observation is that 

0^(<, x-y)^E fe„^^„ exp UaB^{t, .)) exp {i2na{x - y))] (51) 
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where exp {i2TTa{x — y)) denotes the n-dimensional vector with n identical en- 
tries exp (i27ra(.T — y)). Note that (??) may be rewritten with 



600 {x- y) ■■= fcxp (i27ra(x - y))) 

\ / q6 



(52) 



such that the resulting expression reminds of the fundamental solution. Note 
that the sums in (51) and (52) are standard sums over the standard set Z". 
These are external objects. However, we are interested in certain projections on 
standard space related to classical solutions of parabolic systems. This motivates 
the definition 

B«^^(t,.) := (cxp(mB^(t,.))) (53) 

For each a G Z" we call B^^^ the ath mode of B'^'^ Next we can state the 
main theorems of this paper. 

Theorem 2. (Feynman-Kac formula for parabolic systems on the n-torus) Let 
A = A'^, A'^ — {a]^i) with constant entries a]^i, and assume that all Aa defined 
as above are strictly positive whenever a = (ai,--- ,a„) where ai ^ 0. Let 
f e [L^ (T")]", i.e., f = (/i, •••,/„) along with fi e L^ (T"). Put 



u{t,x) =° E 



^ exp {iaB^{t, .)] f„ 



where 



fa 



fa exp [i^-Ka^x)) 



along with 



(/la exp (i27ra(x)) , • • • , /„„ exp {i2'Ka{x))) 

fa (/let; ' ' ' J fna) j 

fia = / fi [y) exp {-i2TTay) dy, 



(54) 

(55) 

(56) 
(57) 



fii^) = X! /ia exp (i27rQ;a;) . 

aeZ" 

Or, written alternatively, put 

uit,x) =°i?[(B«'^(i,.),foo (x) 

where _^ 

foo (x) (fa exp {i2Tra{x))) 

du _ Y^n Aij a^u 



Then u satisfies 



U = f 



(58) 

(59) 
(60) 

(61) 



Moreover, if u is the solution of the equation (61), then this solution has the 
representation (63) or (54). 



11 



This formula can be extended to more general cases with B ^ and C ^ 0. 

Remark 3. Note that our the Feynman-Kac formula is interesting from a com- 
putational point of view because all a-modes can be computed parallel and the 
contribution of an a-mode decreases exponentially as the size a = Yl^=i 1*^*1 
of the corresponding multiindex a increases (for t > 0). Note furthermore that 
schemes proposed in [7], [8], and [5], may be generalized to the present situation. 

As we see the generalized Brownian motion (63) corresponds to parabolic 
systems with constant coefficients. A more general class of stochastic processes 
can be constructed from this by infinite stochastic differential equations (similar 
as scalar partial differential equations arc correlated to finite stochastic differ- 
ential equations). For elliptic boundary problems we say that the general Hunt 
condition is satisfied for B^'^ if the standard Hunt condition is satisfied for 
every a-mode i3^/^(<, .), i.e., that every semiploar set B^^^{t,.) is polar for 
S^(t, .). We have 

Theorem 4. (probabilistic solution for elliptic boundary value problems of parabolic 
systems) Let A and f satisfy the same assumptions as in the preceding theorem. 
Assume that C T". Assume that for f = (/i, • • • , fnf" and all \ < i < n 
all functions fi are bounded continuous functions on dfl, the boundary of Q. 
Assume that the general Hunt condition is satisfied, and that v is solution of 
the elliptic boundary value problem 

V" 4 'J = 

(62) 

lmix^yv(x) = {{y) for all regular y e dD dfl. 



The 



vix)^°E (Bf^^,t^{x)) , (63) 



where r^^ denotes the first exit time from the domain if the process starts at 
X e T". 

The proof of the first theorem is in the last section of this article, and the 
second follows from the first by standard arguments. In order to make the 
paper better readable to analysts we next provide a selfcontained introduction 
to nonstandard (stochastic) analysis. 

3 Some remarks about mathematical systems 
with exphcit infinitesimals and their relation 
to classical mathematics 

The e-(5-H2-formulas of Weierstrass almost eliminated explicit references to in- 
finities and infinitesimals from classical mathematics. However they can be 
re-introduced in the framework of functional analysis, where in the theory of 
non-commutative geometry (invented by Alain Connes) infinitesimals are just 
compact operators for example. Other rival theories with explicit infinitesi- 
mals are topoi in synthetic differential geometry. These topoi are different from 
classical topoi in general since a term non datur does not hold. Logically, non- 
standard analysis can be formulated in the framework of the Zcrmelo-Frankel 
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system with the axiom of choice. Therefore, if no additional assumption (ad- 
ditional generosity concerning the enlargements of the universe) is made, then 
nonstandard analysis is logically equivalent to classical analysis based on ZFC. 
Modern system of mathematics differ with respect to the treatment of infinity. 
The rules for infinite objects can also affect the basic logical structure. This is 
true not only for intuitionist mathematics, but also for may other topoi which 
are used in different branches of mathematics. For example Euclid's assumption 
that 'for any two points in the plane, either they are equal, or they determine 
a unique line' may be interpreted to mean that the real number system which 
represents the line is actually a field. However if we introduce infinitesimals 
axiomatically by requiring that the set 

Inf(O) ;= {x 7^ 0\x^ = 0} (64) 

is not empty, then the axiom of synthetic differential geometry that the map 

R X K ^ M^'^f^o) 

(65) 

(r, s) ^ [6 ^ r + Ss] 

is invertible becomes false. Typically in such axiomatic systems the law of 
excluded middle is also not valid. This means that different treatments of infinity 
(implicit as in Euclid or more explicit as in modern systems) lead to different 
interpretations of intuition and space. Intuition or our naive common sense 
concept of space cannot be a guideline to choose a system because these concepts 
are to vague in order to make any choice preferable. 



4 An introduction to elementary nonstandard 
analysis 

We extend the set real numbers M to a certain set of so-called hyperreal numbers 
*M. *M will contain a copy of R and the infinitesimals and much more. Speaking 
roughly, *R contains equivalence classes of sequences of real numbers, where 
equivalence of two sequences is induced by a nonprincipal ultrafilter on the 
integers N. Real infinitesimal numbers arc just equivalence classes of sequences 
which converge to zero. So formally the outline of this chapter is as follows: we 
construct a nonprincipal ultrafilter J- . Then we consider the set of sequences 
of real numbers R^ = {/ : N — >■ R}. We define the set of hyperreals by 

*R = R^/J", (66) 

where for /, /' e R^ 

/^/'iff {n|/(7i)-/'(n)}e J^. (67) 

This is the so-called ultra-power construction of the hyperreals. To understand 
it in detail we first go into the construction of nonprincipal ultrafilters. 

Remark 5. Why do we not just take R^ in order to define *R? The reason is 
that it seems difficult to define operations such that M.^ has the structure of a 
field. Pointwise operations do not work, because (2, 0, 2, • • • ) • (0, 2, 0, 2, • • • ) 
(0,0,0,0---). 
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5 Nonprincipal Ultrafilters 



Let S be an nonempty set and let V{S) ~ {A\A C S} be the power set of S. 
We say that a nonempty set T C 'P{S) is a fiher on S if it is closed with respect 
to intersection and supersets, i.e. 

i) A, B e J" ^ A n B e J", 

ii) AdB, AeT, B d S ^ B e T 

Note that G J-' implies that for all A C S A A filter T is called proper 

iff ^ A proper filter on 5 is called an ultrafilter if 

iii) for all A C S* either A or A'^ is in J^, 

where A"^ = S \ A denotes the complement oi A in S. An example of a proper 
filter which is not an ultrafilter is the filter of co-finite sets on an infinite set S, 
i.e. T""" := {A C S\S \ A is finite}. If B C 5 is a set then 

-F^ = {A\S D A D B} 

is called the principal ultrafilter generated by B. We call a filter principal if it is 
generated by a singleton, i.e. a set with one element. In that case we write J-^ 
instead of J^^^^ for simplicity of notation. For an ultrafilter this is equivalent 
to defining a filter as principal if it is generated by a finite set. For if T is 
generated by B = {xi, ■ ■ ■ ,x„} assume that {xi} ^ J-. Then S \ {xi} e J-. If 
this holds for all Xi, then 

= n^^iS'\{a;,}nBe J". 

Hence, since is proper there is one x G B such that {x} G J^. Hence 

T:={A\Ad {x}}. 

To put it otherwise, if a principal ultrafilter is generated by a finite set, then it 
is generated by an element of that finite set. We call an ultrafilter nonprincipal 
if it is not principal. But do there exist nonprincipal ultrafilters? The answer 
is given in the next section. 

6 The Axiom of Choice implies the Existence of 
nonprincipal ultrafilters 

Let be a infinite set. First we say that a collection H C P{S) has the finite 
intersection property (f.i.p.) if for any n G N 

^i,--- ,A„GB^n^Li^»^0- (68) 

Let 

J"" := {AC S\AD Bin---n Bn for some n and B, G H} (69) 
be the filter generated by H. 

Lemma 6. If H has f.i.p. then C P{S) can he extended to an ultrafilter 
on S. 



14 



Proof. Consider the p.o. {V, C) of filters, where P = J" D J"^}. If L is 
a chain in {V, C), then K := UL E V (since UL is a filter). Recall that 

\J L = {x\3y L -. x £y} . (70) 

Hence, by Zorn's lemma (7^,C) has a maximal element, which we name by K 
again. Note that ii' is a maximal proper filter on S (since K has the finite 
intersection property K is proper). We want to show that K is an ultrafilter. 
If K is not an ultrafilter, then there is A C 5 such that neither A nor A"^ is 
in K. Assume that K U {A} does not have f.i.p., i.e. assume that for some 
-Bi, • • • ,Bn e K we have Bi n • • • B„ n A = 0. Then 

Bin---nB„nA^ = Bin---B„. (7i) 

Hence, K U {A'^} has f.i.p.. Since K is maximal A'^ £ K. Hence K is an 
ultrafilter. 

Remark 7. We present here the classical introduction to nonstandard analy- 
sis. Most hut not all working mathematicians accept the axiom of choice (AC). 
Within the framework of the classical Zermelo-Fraenkel axiomatic system the 
AC leads to the famous paradoxes first discovered by Banach and Tarski. In 
that framework you can construct a subset A of the two dimensional sphere S"^ 
such that for each natural number n there are n rotations i?i , • • • , i?„ on S"^ 
such that 

5*2 = i?i(A)Ui?2(vl)U---Ui?„(A). (72) 

Hence it is not possible to assign a measure to A in a reasonable way. Espe- 
cially, a rotation invariant measure would have to assign the value ^ \, \, etc. 
to the same set A! Therefore it is interesting to design a constructive nonstan- 
dard analysis. Another reason to consider constructive versions of nonstandard 
analysis is the fact that we have to impose the continuum hypothesis ( CH) 

Hi = 2^" (73) 

in order to ensure the uniqueness of *M. However, CH is even independent of 
ZFC as was shown by Gddel (who constructed a model of ZFOJCH 1939) and 
Cohen (who constructed a model of ZFOJ^CH 1939). 

Theorem 8. // S is an infinite set, then there exists a nonprincipal ultrafilter 
on S . 

Proof. Define the Frechet filter 

F"" = {A C S\A'' is finite }. (74) 

F'^° is a proper filter (not an ultrafilter, since there exist 81,82 both infinite 
such that 5*1 U S'2 = 8). However. F^'^ has the f.i.p., so can be extended to a 
filter J- D J-^^' by the preceding lemma. We observe that T is nonprincipal, for 
if is a principal filter generated by {x}, then 8 \ {x} ^ but 8 \ {x} e F. 
Hence F 7^ for all x. Hence F is not principal. 
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7 Extended real numbers, infinitesimals and un- 
limited real numbers 



We take a nonprincipal ultrafilter on N and define 

*R = R^yj' (75) 

where for y G M'*' 

cc - y {i\x^ = y,} G I'. (76) 

We embed M in *R identifying x e R with [{x,x,--- ,x, •••)], i.e. a; G M is 
represented by the equivalence class of the real number sequence sequence which 
is constantly x. We define extensions of standard operations 

+ : *M X *R ^ *R [x] + [y] := [{x, + y,)] , 

(77) 

• : *M X *R ^ *M [x] ■ [y] := [{x, ■ y,)] , 

and 

r ^ ,if ^^ + 

N"':=[(y.)] V^^\ ^ • (78) 

[ 0, else 

Furthermore, we define extensions of standard relations by 

<C *R X *M, {x\ < [y] iff {n\xn < Un} e F. (79) 

Similarly for <, >, =. Furthermore, let 0* = [(0, • • • , 0, • • • )] and 

1* = [(1, 1 • • • , 1, • • • )]. We identify 0*, 1* with 0, 1 respectively. We have 

Proposition 9. (*R, +, •, —1, <) is an ordered field with zero and unit 1. 

Proof. First we show that (*M, <) is a total order, i.e. 

Va;,y G *R : [x] < [y] or [x] = [y] or [x] > [y] (80) 

Note that 

N = {i\x, < y^} U {i\xi = y,} U {i\x^ > y^}. (81) 

Since is an ultrafilter exactly one of the three sets is in For pedagogical 
reasons let us be a little more explicit at this point. Let = {i\xi < yi}, 
A= = {i\xi = yj, and A> = {i\xi > yj. If e T then A= U A^ ^ J. 
Neither A^ nor A> can then be in T ^ because T is proper. If A< ^ T , then 
A= U A> e T. If in addition to y4< ^ J" A= e T, then A> ^ J" (since 
T is proper). On the other hand, if A< ^ T and A^ ^ J^, then A> S T 
or A^ U j4< G J^. However, the latter is impossible, since A< ^ T implies 
e J" and A= ^ J" implies A% € J", so n A5i = (A< U A=)'= e J". 
Hence A< U A= ^ J^. Hence, we have either a; < y (if A< e J^) or a; = y (if 
A^ € F) or X > y (if A> G J^). Next the field laws have to be checked. These 
follow immediately from congruency of the operations + and • and the inverse 
operation. By definition, this means that the operations are well defined. We 
show this for +, i.e. we show that 

[(x,+yO] = [(xO] + [(y,)]. (82) 
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Now, if [(i,)] = [{x,)] and [(y,)] = [{y^)] then 



{i\xi = Xi} e and = j/J e J". (83) 

Hence, 

{i\xi = Xi k iji^ yi} € J", (84) 
by the filter property of J-. Hence, 

{i\x, = Xi and iji = y^} C + = Xi + yj £ J". (85) 

Similar for the other operations □ 

So what is an infinitesimal? We can say an infinitesimal is a number in *R 
which has modulus smaller than all standard real numbers. So let us define 
modulus first: for all x — [(a;„)] e *R we set 

N = |[(-^n)]|:=[(K|)]. (86) 

and we say that a; G *M is an infinitesimal if 

$.„f(a;) = Ve e R(0 < e ^ |a;| < e) (87) 

holds. Recall that wc identified R with a subset of *M. A few remarks arc in 
order. First, each standard real number a; G R has a whole bunch of infinitesi- 
mals around it. They are called the monad of x and we have proved that they 
are linearly ordered. We define 

md(x) ~ {yl'fUy - x)}. (88) 

Well, we have not defined what y — x is. but it should be clear from the context 
that 

yx,ye*R:y-x^ [(y,)] - [ix^)] = [{y^ - x,)]. (89) 

Since *R is linearly ordered we may call a; G *R positive infinitesimal iff x > 
and $(a;). An element x G *R is called unlimited if for all r G R r < |a;|. 

8 Further remarks 

The ultrafilter construction of the hyperreal numbers is unique if the continuum 
hypothesis holds. Godels proof of equiconsistency of ZF and ZF U AC U CH 
shows that this is not as bad a situation as one may think. Let us consider the 
question of cardinality of R* with and without this hypothesis. Since R can be 
embedded into *R and *R consists of equivalence classes of elements of M'*', it is 
clear that 

Hi < cardR = 2^" < card(*R) < card(R^) = 2^""° > H2 (90) 

holds. Next we show that for each standard number x G R the cardinality of 
the monad of x is at least the cardinality of the real number. We construct an 
injection from the standard real numbers into the monad of (the injections to 
mdix) can be constructed in the same way). Consider representations of real 
numbers r G R by decimal expansions 

r = r™r™„i • • •ro.r_ir_2 • ■ ■ • (91) 
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Consider an enumeration of the prime numbers po,pi,p2 ■ ■ ■ and the map 

r ^ [(r+)] (92) 

with 

:=Po'''"Pr""' •■■Pn (93) 

This is indeed an injection by uniqueness of prime factorization of natural num- 
bers. If the (general) continuum hypothesis holds then the cardinality of *IR is 
H2 and *R is unique. 

The set *]R which we constructed as equivalence classes of real sequences 
with respect to an nonprincipal ultrafilter J- in the last Chapter is just a set of 
numbers. To do nonstandard analysis and nonstandard stochastic analysis later, 
we need to talk about sets, functions and relations. It is possible to extend the 
ultrafilter construction to this kind of objects. First, for A C M we may define 

xeA*iS {n\xn e T}. (94) 

If a; = a; G ^4*, then {ri|a;„ — x„} G J-. Hence, 

T 9 = Xn and x„ ^ A} C {n\x„ G A} e (95) 

Similar, a function / : R — )■ M extends to a function 

r:*R^*M, r{x)^[{f{xr,))]. (96) 

This is well defined, again. If x := [{xn)] = [{Vn)] ='■ y, then {n|2;„ = y„} G J-. 
Hence, {n\xn = Un} ^ {"|/(a;„) = /(y,i)} e J^- Hence f{x) = f{y). Similarly, 
a relation S C (R)™ extends to 

5*C(*R)™ (xi,--- ,x„)g5* iff{n|(a;i„,--- ,x,„„)g5}g J- (97) 

So wc could reconstruct all properties of analysis on R which are exprcssable 
in first order logic by the ultrafilter construction. However, the ultrafilter con- 
struction is at the very heart of Loos theorem which is essentially the transfer 
principle of nonstandard analysis. In order to state and proof the theorem of 
Loos we need some basics of mathematical logic, which we describe in the next 
Section. 



9 Elements of Mathematical Logic (preparation 
for the theorem of Loos) 

In order to fix notation for a proof of the thorem of Loos, we introduce basics of 
first order logic, i.e. the setup of formal first order languages, the logical axioms 
and rules of inference, and first order semantics. 

9.1 Formal first order Languages 

The object first order language which we consider consists of an alphabet with 
ai) logical symbols: ^ (not) A (and) V (for all) — (equality) 
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aii) variables: elements of V := {vi\i G N} 

aiii) relation symbols: elements oiTZ := {Ri\i E 1} 

aiv) function symbols: elements of J-f := {fi\i G J} 

av) constants: elements of C :— {cfcjfc e K} 

avi) auxiliary symbols: ) , ( 

Here, /, J, K are arbitrary index sets. Next we build terms inductively as 
follows: 

ti) all Vi Cz V and G C arc terms 

tii) if ti, • • • , are terms, and j G J, then fj (ti, ■ ■ ■ , is a term, 

tiii) No other concatenations of symbols are terms 

Here, n : J ^ N \ {0} is a function which assigns to each index j E J the 
number of arguments of the function fj . We denote the set of terms by Tm. 
Next we build up formulas. 

fi) if ti,t2 are formulas, then ti — t2 is a formula 
fii) if ii, • • • , tx(i) are terms, then Ri (ti, ■ ■ ■ , ^A(i)) is a formula 

fiii) if (j) and ip are formulas, then so are ^0, {(j)Aip), and Vui0 for some Vi G V. 

fiv) No other strings of symbols are formulas 

Here A : / ^ N \ {0} is a function which assign to each i G I the number 
of arguments of the relation Ri. For convenience and (partially) abusing these 
formal restrictions we fell free to use 

coni) the symbols u, v, w, x, y, z with and without indices as variables 
conii) (j),ip,a,l3j with and without indices as symbols for formulas. 
Furthermore we use the abbreviations 

abi) {(j) V -0) stands for ^ (^0 A ^-0) 

abii) {(j) — > -0) stands for ^ (0 A ^ip) 

abiii) (0 -0) stands for (0 — > ■0) A (?/' — > 0) 

abiv) 30 stands for ^V^0 

We also use the following conventions which make the formulas more acces- 
sible to the human reader 

ci) A and V have priority to — > and O 

cii) ^ has priority to V and A 

ciii) ti ^ t2 stands for -^ti — t2 
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civ) Vm, ■ ■ ■ stands for VitVwVtu and 3a;, y, z ■ ■ ■ stands for 3x3y3z. 

cv) wc avoid the brackets if this does not lead to ambiguities, e.g. 01 A 02 A 03 
stands for ((0i A 02) A 03) etc. 

Next we need the notion of free variables. We define the set of the free variables 
of a formula Free(0) inductively. We set 

Fi) Frce(0) = {v E V\v occurs in 0} 

Fii) Free(^0) = Free(0) 

Fiii) Frce(0 A V') = Frec(0) U Free(?/') 

Fiv) Free(Vu0) = Free(Vu0) \ {v}. 



Furthermore, we need the syntactic operation of substitution of a variable v 

V 

in a string of symbols by a term t. Let be the string of symbols which is 

t 

obtained, if all occurrences of v are replaced by t. If the variable v in a, formula ip 
is in the domain of a quantifier Vu and u occurs in the term i, then the variable 
u becomes part of the domain of quantor Vu. If this does not happen for all 
variables in the term t, then t is called free for v in ijj. The formal language is 
determined by the functions A, /i, and the set C. We write 

L==(A,/i,C). (98) 
9.2 Logical axioms and rules of inference 

There arc a lot if axiomatic systems which lead to logical first order complete- 
ness. We use a very simple form. The logical axioms are 

tl) tautologies of prepositional calculus 
ql) quantifier rules 

yx(j) — 1 ^ if t is free for x in 

(99) 

Vx (0 -> -0) ^ (0 yxip) if X ^ Free(0). 



il) axioms of identity 



X = y ^ (x = z ^ y = z) 

x = y^ ,x,---) = !j{--- ,j/,---) (100) 
( same place of x and y in argument /ij- tuple of /) 

a; = y ^ Ri{- ■■ ,x, • • • ) = Ri{- ■■ ,y, • • • ) 

( same place of x and y in argument A^-tuple of Ri) 
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Next we have the rules of inference 

V, 01- V'- (101) 

Finally, the rule of generalization is 

(j) h Va;0. (102) 

9.3 First order semantics 

Let L = (A, /i,C) be a formal language as stated above. A L-structure 



A 



[A{Rt)^^,Aft),eJ.{ctWc) (103) 



is determined by the data of a set A of individuals, a family of relations R!^ C 
^i'g/ , a family of functions : A, and a set of constants {c^ E A\k G A'}. 

A map 

e:V^ A (104) 
is called a valuation map. Furthermore, we define 

( e{v) ,if V ^ 
eHv) := <^ . (105) 




The value of a term t € Tm with valuation map e is defined inductively. We 
have 

tei) w^(e) := e(w) 

teii) ci{e) := 

teiii) /, (ti, • • • (e) = // (ttie), ■ ■ ■ ,i^)(e)) 

The validity of a formula is a relation between the model A, the formula (j) and 
the valuation map e which we write 

A h (106) 

and define inductively 
mati) A^ti= t2(e) iff tf{e) = t^{e) 

matii) ^ h (ii, • • • , iA(,)) (e) iff Rf {tt{e), ■ ■ ■ tj:^^ (e)) . 

For connectives and quantifiers the following rules hold 

mfi) A h -(/-(e) iff ^ (/>(e) 

mfii) A'r{<j)^ i}){e) iff h 0(e) and A h V^e) 
mfiu) ^ Va;(/)(e) iff |= 0(er) for all a G A. 
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9.4 The transfer principle 

Transfer principle 

*R h iff K h 0(e)- (107) 

(j)* is defined inductively. For constants c G C and variables x € Var we have 

c* — c and x* ~ x. (108) 

If / is a k-ary function and ti, • • • , are terms, then 

/(n,... ,Tfe)* = r(T*,... ,r,!). (109) 
Similarly, if P is a k-ary relation and ti, • • • , arc terms, then 

P(ri,... ,Tfe)* =P*(t*,... ,t,!). (110) 
This defines (j)* for all atomic formulas (f). Furthermore, if -0 = ^0, then 

r = ^r. (Ill) 

and if -0 = (^i — 02), then 

0* = (0^->0;). (112) 

It is well known that {^, — )■} is a complete set of connectives for classical propo- 
sitional calculus. So, the *-transform for A etc. follow from the ^-transform for 
-I and — Next, including quantifiers, if 0; = Va; € A(j>, then 

i'* =yx e A*(l)*, (113) 

and the transform of "0 = 3a; €E A(j3 is implied by 3 = ^V^. The transfer principle 
is a consequence of the theorem of Loos. 



10 The theorem of Loos 

Let S be an index set. For all s e 5* we consider the model 

y^''- = (^^R^F^c''), (im) 

where R** is a set of relations, ,F* is a set of functions, is a set of constants. 
We saw that the axiom of choice implies for any system D of subsets of a set 
M which is closed under finite intersections the existence of a superset J- D D 
which is a nonprincipal ultrafiltcr. Next wc define the ultraproduct of the yl*' 
with respect to J-. Let us consider the set of sequences 

n^esA" = {(a") \a' e A" for aU s e S} . (115) 

Two sequences (af)gg_g and {0,2) ses ^^'^ called equivalent with respect to if 
they coincide on a set of T, ie. 

K)ses («2).e5 iff - "2} e ^- (116) 
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Since is a filter the relation is an equivalence relation. For the sake of 
brevity we shall write (af ) instead (ai)^^^ in the following. Now let 

^ = {[K)]IK)en,esA^}, (117) 

where 

[ia')]^m\ia')-^ibn}. (118) 

Next on A we define the Ri for i G I, Fj for j G J, Ck for k G K such that we 
can construct the structure 

We call A the ultraproduct of the structures A'^ and write 

A = U^esA'/T. 
The relations Ri are defined as follows. We set 

i?.([(aD],-- - ,[(«AW)]) iff {seS\R,[al- 
We define functions Fj for j G J as follows: 

/,([(ai)1,...,[(a,(,.))^]) :=[(/, (a^...,a^(^.)))' 
Similar for constants 

Ck = M)] . 

In order to formulate the theorem of Loos we need the concept of valuation of 
sequences. For all s € S" let be a valuation maps of the variables in A^ . We 



e T. 



(119) 
(120) 
(121) 

(122) 
(123) 



define 



[(e'')] : Vbl ^ A, 
[(e^)] M = [e%v,)] 



(124) 
(125) 



If a = [{a')] e ^ then 

We abbreviate e = [(e*)]. The theorem of Loos then says 
Theorem 10. 

A^cl,{e) tjf{s\A' ^cl,ie^)}eT (126) 

Proof. The proof is by induction on the construction of the formulas 0. If cf) 
is a prime formula, then the equivalence follows by the equivalence of constants 
Ck functions fj and relations Rk as indicated before. Note also that 



(127) 



If I 



then 



A^^ij{e) iSAl^ijie) 

iSA^ibiiie^)]) 

iS {s\A' hV'(e-')}^-F 

ifl[S'\{s|yl'' V(e'')} e J- 

iff {s\A' V(e")} e 



(128) 
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If (/) = '0 A X, then 

^ h (V^ A x)(e) iff ^ h ^(e) and A h x(e) 

iff {s\A' h ^ (e')} e -7" and ^ X (e")} e 

(129) 

iff h V' (e")} n {s\A'' h X (e")} e -7" 

iff h(^Ax) (e-')}e 

Finally, if is of the form Vxi/;, then 

iffylh^([e'D) forallae^ 

iff ^ h ^ ( [el^J ) for aU (a^) e H.^s^^ 

iff {s|yl-' 1= ij] {e'\l^)] e J" for aU {a') e IlsesA' (130) 

iff {s\A' h V' {e'll^) for aU a'* G A'} e J" 

iff {sl^t" h Vxi/' (e")} e J" 

Here, the fourth step can be justified as follows. Let 

U ^ {s\A' h V (e'll^) for all a' G A''} (131) 

For any sequence {b'^) £ Ilsgs^" we have then On the other hand, if ?7 ^ J^, 
then s\U & F. 

V = {s\A'' i) {e'^^^i for some a' e A*} e J" (132) 

Then define a sequence (5^) where }f equals some a" with A' y= ^ (e^l^J if 
s g y and some a* S else. Then 

y (133) 

and since y S we have 

{s\A'^i,{eX^))^T, (134) 

which is impossible. 

11 Introduction to enlarged universes and mea- 
sure theory 

Stochastic analysis is a part of measure theory and measures assign numbers to 
sets. Nonstandard stochastic analysis is applied Loeb measure theory and Loeb 
measures assign values to internal sets. So we have to agree on what is a set 
(which axioms of set theory we take for granted). Next a good framework of 
measure theory are universes and we have to define enlargements of universes. 
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which we do by the ultrafilter construction. Then we define internal sets within 
the enlarged universe. This is the program. Some remarks are in order. 

The foundations of mathematics can be displayed either in the classical 
framework of set theory (especially the Zermelo-Fraenkel system) or within the 
framework of category theory (and here especially in the framework of topos 
theory). The categorical approach and especially the topos theoretic approach 
is the most advanced view on the foundations since it allows us to represent 
different point of views on mathematics under one uniform roof. E.g. the logic 
of topos theory is intrinsically intuitionist but shcafications lead to classical 
mathematics in an elegant way. However, since topos theory is not that popular 
we consider set theory in this introduction. Since the subject of nonstandard 
stochastic analysis is a challenge in itself we do not want to make things more 
difhcult by using the categorical approach. However we do not use exactly ZFC. 
The reason is that restricted quantifiers are enough for our purposes. Recall the 
ontological premise of Quine ("On what there is"): "to be is to be value of 
a variable" . Variables are exactly what we quantify over. So what exists in 
restricted ZFC (sometimes also called "bounded Zermclo") are elements of sets. 

12 Bounded Zermelo 

Bounded Zermelo is ZFC with quantification restricted to existing sets. The 
language of bounded Zermelo is a normal set theoretic language, with the ex- 
ception of the restricted quantification rule, i.e. for any formula 0(x) with the 
free variable x and sets a, b 

3x e a(/)(.T), Vx e b(f>{x) (135) 

are formulas. Denote the usual set theoretic language with bounded quantifiers 
by £r. We list the axioms of restricted ZFC (RZFC in symbols). 

(E) (Extcnsionality) ?; = a; iff , for all z, z e a; iff z e y. 

(RC) (Restricted Comprehension) If </>(a;) is an £fl- formula (with quantifiers 
restricted) and free variable x and a is a set, then there exists a set b with 
X €z b iS X € a and (f>{x). 

(NS) (Null Set) There exists a set such that for all a; a; ^ 0. 

(P) (Pair) For all x and y there exists z with u G z iff m = .t or it = y. 

(U) (Union) For all x there exists y with z G y iff there exists w with z G w G y. 

(PS) (Power Set) for all x there exists y with z G y iff z C a;. The set y will be 
denoted by P{x) 

(F) (Foundation) For all x ^ (Z) there exists a set y G x with y n .t = 0. 

(I) (Axiom of Infinity) There exists a set N such that G N and a; G N 
implies x U {x} G N 

(AC) (Axiom of Choice) if / 7^ is an index set and for all i E I Xi ^ 0, then 
H,g/X, ^ 0. 
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Bounded Zermelo is well known to be equiconsistent to a model of the first order 
theory of well-pointed topoi. However, as explained before, we are not dealing 
with the topos-theoretic view here. 

13 Mathematics within first order logic 

The goal of the present chapter is to extend the construction of chapter 1 to 
universes of sets. This is a basic step in order to set up nonstandard measure 
theory. We shall consider to types of extensions of universes (systems of sets with 
certain closure properties) . The first extension is called enlargement of universes 
and is one is an axiomatic enlargement of an universe U and is defined as an 
embedding 

[/ A C/' (136) 

which satisfies some axioms. The second one is a generalization of the ultrafilter 
construction of chapter 1 from the special set R to universes. It is clear that the 
construction of a nonprincipal proper ultrafilter of chapter 1 can be extended 
to any index set /. So we seek for some object of the form 

"U*:=U^/r\ (137) 

But before we step into that subject we consider first a more fundamental ques- 
tion. In the preceding chapter we formulated first order logic, and proved the 
theorem of Loos in the case of real and hyperreal numbers. However if we look at 
propositions of the working mathematicians we see that quantifiers are applied 
to sets in general which is covered only by higher order logic. Moreover, it is 
well-known that elementary structures of mathematics like the natural number 
system N cannot be characterized up to isomorphism by a first order axiomatic 
system. The Peano axiomatic system of the natural numbers is characterized 
therefore in second order logic. 

PI Va;-cr(a;) = 

P2 VxVy {cr{x) = a{y) x = y) (138) 

P3 yX {X{0) A Vx {X{x) X{<t{x))) ^ VX(y)) 

(Here sets X arc identified with univariate relations). 

The axioms (P1)-(P3) characterize the standard arithmetic structure (N, •, +, 0, 1) 
up to isomorphism, and it is a result by elementary model theory that this struc- 
ture cannot be formalized by a finite first order axiomatic system. However, in 
this section we shall show that nevertheless mathematics can be essentially ex- 
pressed as a first order theory within a set theoretic axiomatic system expressed 
by a first order language with one binary relation symbol €. The latter propo- 
sition is empirical of course inasmuch it refers to mathematics as a subject of 
propositions expressed by past present and future mathematicians. 

We exemplify it (and make it plausible) by formalization of a theorem by 
Dedekind 

Theorem 11. Two Peano structures are isomorphic. 

which cannot prima facie formalized on a first order level, since 
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Theorem 12. No model A with infinite set A is characterizahle in first order 
logic up to isomorphism (i.e. IS.- elementary). 

Proof. Let ^ be a model with infinite set A and let $ be a set of sentences 
interpretable in A. Consider the set of models 

{B\B'^A} (139) 

The set $ has an infinite model. Next recall 

Theorem 13. (Lowenheim & Skolem) Let ^ be a set of expressions which can 
be satisfied by an infinite model. For any set A there is a model of $ which has 
at least as much elements as A (in the sense that there is an infinite model of 
<I> with set B such that there is an infective function from A to B). 

Thecfore $ has a model B with set B which has the cardinality of he power set 
of A. Since card(A) < card(P(yl)) B is then not isomorphic to calA. Therefore, 
Peano structures cannot be characterized by first order theories. Nevertheless 
we can avoid this consequence somehow. We shall show: in a formal first order 
language with the set of symbols S = {U,M,£) with the univariate relation 
symbols U and M with the interpretation " . is urelement" and ". is set" 
respectively, and the relation symbol x £ y {"x is element of y" ) it is possible 

i) to formalize the theorem of Dcdekind in the first order language S 

ii) to prove the theorem of Dedekind in a first order system. 

These facts (and similar experiences) let us believe that first order logic is 
sufficient in order to express mathematics. 

Next we shall make this more precise (plausible) by formulating an axiomatic 
system in the language Ls. 

{AO) WxiUxWMx) 

"every object is either urelement or set" 



{Al) \fx^{UxAMx) 

"no object is urelement and set at the same time" 

(140) 

(A2) VxV (((Mx A M A^z (z e X ^ z e y)) ^ X = y) 
" two sets are equal if the contain the same elements" 

(A3) WxWyBz {Mz AWu{u e z ^ {u ^ xV u =))) 
"two sets are equal if the contain the same elements" 

In order to make further formalization more readable we introduce the abbre- 
viations 
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(C) X (-y = Mx A My Ayz{z e X ^ z e y) 
"x is subset of y " 

{GPzxy) GPzxy = Mz A yu{u e z ^ {Mu A (Vw(w e u ^ v ^ x) 

VVw {v (z u ^ {v ~ x y V = y)))) 
" z is the ordered pair of x and 2/" 

(GTuxyz) \/x\/ {{{Mx AM A^z {z e x ^ z e y)) ^ x = y) 
''u = {x,y,zr 

(GPEuxy) WxWyBz {Mz A\/u{u e z ^ {u ^ xy u =))) 
"(x,y)eu" 

(Fu)i^M = Mu A Vz(z e M — > BxByGPzi'y) A ^xiy^y' {{Euxy A Euxy') y ^ y' 
"u is function 

Dfv= Ff AMv A\/x{x & v ^ ByEfxy) 
" V is domain of the function uf" 

{Bm/)Buv = Fu A Mv A Vj/(y G w -f-!- 3xEuxy) 
"t! is image of the function u." 

(141) 

Next we use the preceding abbreviations in order to formahze Peano struc- 
tures. 



14 Universes and enlargements 

The axiomatic system RZFC tells us what sets are. In set theory sometimes you 
take entities for granted (as Kronccker expresses that the natural numbers arc 
given by god, and the rest is constructed by mankind). Similar in nonstandard 
theory we tend to consider some set as the set of urclements. In ZFC people 
realised that urelements are superfluous. However, when we talk about universes 
over we include urelements as convenient. We denote sets by capital letters 
and elements which are either sets or urelements by small letters. E.g. in A e U 
A is a set, while in a € U a may be a set or an urelement. A universe is a set 
with certain properties. First if ^ € U is a set, then we want all elements of a 
to be present in U, i.e. 

aeAeV => aeV. (142) 

Any set U which satisfies 142 is called transitive. Furthermore, in a universe we 
want to have with a set A € U its transitive closure Tr{A) € U. Here Tr{A) is the 
smallest transitive set that contains A. If A is transitive itself, then A = Tr{A), 
of course. We require: 

if A e U, then there ex. a transitive set B e U with Ac B cV. (143) 
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Finally we require (and are allowed to by RZFC) that 
if a, 6 e U, then {a, b} e U 

if A, B e U are sets, then AUB eV (144) 

if A e U is a set, then P{A) € U 

If the universe contains a set S such that the members of S are individuals in 
the sense that 

Va; e § [a; 7^ A (Vy e U(y ^ x)] . (145) 

The next step of course is to show that universes exist. They are realized by 
superstructures. Let § be a set. Wc define a series cumulative power set by 

Uo (S) = §, 

(146) 

U„+i (S) =U„ (S)UP(U„ (§)). 
Then it is easy to check that 

U(S) := y U„(§) (147) 

riGN 

is a universe. If the set S is known from the context, then we . The language 
Cr with quantification restricted to the sets of the universe U is denoted 
Next, a nonstandard framework for a set S comprises a universe U over § and a 
map 

U A U', (148) 

which satisfies 

a* = a for a € §, 

0* = 0, (149) 

the £'^-sentence </> is true iff 4>* is true. 

Such a nonstandard framework is called an enlargement if the following condi- 
tion is satisfied: 

if A e U is a collection of sets with the finite intersection property, then there 
exists an element z E V such that 

z ef]{Z*\Z e A}. 

(150) 

Example 14. If V is a universe on M and A is the set of intervals 

{(0,r)|r>0} (151) 

then the latter set satisfies the finite intersection property. Then the enlargement 
principle tells us that there exists a positive infinitesimals, i.e. there exists 

b e n{(0, r)*|r > 0} = 'set of positive infinitesimals'. (152) 



29 



Example 15. Consider a universe U on N and an enlargement U ^ U' . The 
set 

A^{N>n\neN} (153) 

with N>„ :~ {m G N\m > n} satisfies the finite intersection property. Then the 
enlargement principle tells us that 

3b:ben{N*>JneN}^N*\N, (154) 

i.e. there is a set of unlimited numbers. 

The question now is whether enlargements really exist. This can be shown 
with the ultrafiltcr construction. Two types of sets arc of special interest for us: 
the first type arc the internal sets: 

a e U is internal if a £ A* for some A eV; (155) 

the second type are the hyperfinite sets: let 

Pf{A) = {B C A\B is finite }. (156) 

Then the hyperfinite sets are the members of Pf{A)* e U'. 

15 The ultrafilter construction of enlargements 

Let / be an infinite set and let be a nonprincipal ultrafilter on /. Let § be a 
set and let let U be a universe over S. To a € U assign a/ e U^, the function 
with constant value a. This way we embed U in a larger universe. Similarly as 
in the ultrafilter construction on M we have to consider equivalence of elements 
with respect to the ultrafilter, this time of functions f,g G U^. We say 



(157) 



f^giS W{t)^g{t)}eT 
feg^f'eg'iS {i\f{{) e g{t)kf'{i) e g'{i)} e J' 

We denote equivalence classes b [.] as before and define 

Wn := {/ e K\ {^1/(0 e U„} e . (158) 

W := U„eNW„ (159) 
Now for / e Wo let [f]:={[h]\heWa\}, and let 

Y = {[/]|/eWo} (160) 

This defines 

Uo(Y)=Y (161) 
Inductively, having defined U„ (Y), for / e Wn+i \ VV,i define 

[/] = {[h]\h e W„ and {i\hii) e f{i)} e T} (162) 

Then 

U„+i (Y) = U„ (Y) U {[/]|/ e Wn+i \ Wn} , (163) 
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and 

U (Y) = U„eNU„ (Y) . (164) 

Now, U (Y) is the ultrafiltcr-cnlargement wc had looked for. For each /, g e W 
itis easy to see that 

[/] e [g] iff {i\m G g{i)} e [/] = {g\ iff = g(i)} e T (165) 

The map 

* : U(X) ^ U(Y), a ^ a* = [a/] (166) 
is an embedding of the universe U(X) in the universe U(Y), and we observe that 

0* = 0, and X* = Y. (167) 

Since T is an ultrafilter, we know that the enlargement 1[J(Y) has nonstandard 
members. Let iu(x) and iu(¥) be the formal languages of the respective uni- 
verses. Denote the model of the ultrafilter-enlargement by Uy = (U (Y) , e) the 
model of the original universe by = (U(X) ,g). Then we get the following 
version of the theorem of Loos. 

Theorem 16. For any Lu(j^y formula 4'{xi, • • • , Xm) cind /i, • • • /,« G W 

Let [/ be a universe (which contains the real numbers as individuals) and 
let J7 — > [/' be an enlargement. For A £ U and let 

Pi.(A) = {&C A|B is finite }. (169) 

Pf{A)* are called hyperfinite subsets of A. As an example, consider Pf(^ and 
the Lc/-sentence 

\/n £ NBA e PF(N)Vm e N [m e A ^ m < n] , (170) 

i.e. the sentence which has the meaning that for each natural number n G N 
there is a set A = {1, • • • , n} in Pp(N). The transfer sentence is 

Vn G N*3A G PF(N)*Vm G [m G A o m < n] . (171) 

Hence, for all n E N* 

A ^ {!,■■■ ,n} e Pf{W- (172) 
Note that n can be infinite, i.e. n G N* \ N. We prove 

Theorem 17. A is hyperfinite iff there exists n G N* and an internal bijection 

f ■.{!,■ ■■ ,n}^ A. (173) 

Here a function / : A — > i? is called internal if the set graph(/) C A x B is 
internal. 

Proof. Consider a Lu-formula 

0(X,r,n,/) (174) 
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which expresses that f : X ^ Y with X = {m E N|m < n} is a bijection. Then 
the Lu-sentence 

V' = Vr e PF{B)3n e mj e P(N x B)3X e P{n)<j3 (x, y, n, /) (175) 

asserts that for all Y S Pf{B) there is a number n and a bijection between X — 
{1, • • • , n} and Y- a sentence which is true. The sentence tp* is true by transfer. 
So if _B G U and A G Pf{B)* then the claim follows from the truth of t/i*. For 
the converse suppose that there is an internal bijection f : X — {\^ ■ ■ ■ n\ A 
for some n G N* . Then A is internal, because it is the range of an internal 
function. We want to show that A is hyperfinite. First we observe that 

3XGP(N)*(/)(X,A,n,/) (176) 

is true. Hence the claim that A is hyperfinite follows from transfer of the true 
iu-sentence 

Vy G B3n G N3/ G P (N x ^) 3X G P (N) (0(X, A,nJ)^Y <E Pf{A)) . 

(177) 



16 Nonstandard proof of the central limit theo- 
rem 

Theorem 18. Let the random vai^iables X„ be binomially distributed with pa- 
rameters p and q = 1 — p. If for n G N* \ N is to G N* is such that 



m — up 
Jnpq 



is in a standard interval [a, b] , then 

^npqBn{m) 



1 



(178) 



(179) 



Proof. Consider the classical formula of Stirling for integer s G N 

s! = \/2^s"e-"exp(e,) , (180) 
where |6s| < yjj- For hyperfinite s G N* \ N the formula becomes 



(181) 



Since x is bounded and ?7i = Tip + Xy/npq, and n — m ~ nq + x^/npq, we have 
— « and « for n, TO G N* \ N. For such n, m (181) gives 



B„{m) 



7n\(n — my. 
Now, consider 

In 



pTa^n-ra 



In I 



2Tim{n — to) m™ m™{n — m)"- 



(182) 



In 



(np + Xy/npq] In ( 1 + x.f-^j — (nx — xJnpq) In (l — x^i-^] (1^3) 



y/npqx — x''q + + ^/npqx — x'^p + x''^ = —\- 



2p X- 
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17 General Topologies 



First wc define general topologies on X € U where U is some standard universe 
in the enlargement U ^ U' 

Definition 19. Let (Z) ^ X £ U . A base at x G X is a set Bx S P{X) such 
that 

VC/, V e Bx3W e Bx ■■ X eW cu nv (184) 

Definition 20. For x G X a monad is a set 

md{x) ■= HueB^U* (185) 

We write y ^ x if y € md{x) . 
Definition 21. O E X is called open, if 

Vx e 03U eBx-.U CO, (186) 

or, equivalently, 

Vx e O md(x) C O*. (187) 

To see the equivalence, first observe that assuming (186) for x € O there 
is U G Bx such that U C O. Hence md(x) C U* C O* . On the other hand, 
assuming (187), if md(x) C O* then 3W G with W C md(x) C O* by the 
definition of monad above and the finite intersection property of B* . Hence the 
judgement 

Vx e 0*3W e Bx :W C md(x) & md(x) C O* (188) 
is true as is the logical consequence 

yx€0*3W eBx-.W CO*. (189) 

Hence, 

Vx e 03W eBx-.W CO (190) 

holds by transfer. The collection of all open sets T is called topology. It is an 
immediate consequence of (187) that the empty set and the set X are open 
sets Furthermore arbitrary unions of open sets are open. Next 

Definition 22. Given Bx for each x Cz X and A C X we say that x belongs to 
the closure of A (in symbols A) if 

md(x)nAV0- (191) 

Hence, we define 

A ■= {x <E X\md{x) n A* (Z)} (192) 

It is easily verified that the arbitrary intersection of claosed sets is closed. 
Note that and X are also closed; sometimes they are called clopen (i.e. open 
and closed). Now, we can define continuous maps for general topologies. 

Definition 23. // {X,T) , {X,S) are topological spaces, then we call f : T ^ 
{Y, S) continuous if 

yv eT (fix) eV ^3U eS :xe Ukf{U) C V) (193) 

or equivalently and more succinct, 

f{mds{x))Cmdr{f{x)). (194) 
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As an example of a topology which is not induced by a metric, consider the 

set 

X^{f: [0, 1] ^ [0, 1]} (195) 

and for / e X 

\e>0,neN,xi,--- , a;„ £ [0,1]}, (196) 

where 

Ue,x,,-,x„ ■■= {g e X\\g{x,) ~ g{y,)\ <e,ieN„} (197) 

So far we have used nonstandard extensions X* of a topological spaces X in 
order to define topologies on X. The topology on X* which is used most in 
the literature is the so-called ^-topology, which has the base B = {U*\U G T}. 
Note that this topology is not Hausdorff since it cannot separate two different 
points of a monad. Next recall that a set A C_ X is compact if every open 
cover of A has a finite subcover. Robinson observed the following nonstandard 
criterion for compactness, the proof of which is left to the reader. 

Theorem 24. A set A Q X is compact iff for each y €z A* there is an x with 
y G md{x). 

18 Introduction to measure theory 

Measures assign values to sets, but not to every set: this is the price of our gen- 
erosity in RZFC with respect to sets. The collection of sets measures are defined 
on are usually cr— algebras. Nonstandard measures are defined on collections of 
internal sets. However, there is one problem: countable unions of internal sets 
are usually not internal sets. E.g. each singleton {n}, where n S N is a is an 
internal set but N = U„gN{''T-} is not an internal set, whenever N* \ N 7^ 0. For 
this reason, the countable union of members of an internal cr-algebra can only 
belong to the cr-algebra if it equals the union of finitely many of its terms. This 
was the essential observation of Loeb. We next review standard measure theory 

19 Rings, Algebras, and Measures 

Let 5 be a set. A ring of sets is a nonempty collection A of subsets of a set S 
that is closed under set differences and unions, i.e. 

li A,B Athen A\B,A\J B A. (198) 

Note that this implies that (Zi & A and that A is closed under symmetric dif- 
ferences and intersections. An algebra is a ring with S A. A. a-ring is a ring 
with closure under countab;e union, i.e. 

An^A for aU n =^ (J An G A. (199) 

riSN 

Example 25. Let N e N* \ N 7^ 0, S := {1, • • • ,iV}. P^{S) :== {A C 
S\A is internal } is an algebra, hut not a a-algebra: we have A„ {1, • • • , n} G 
Pi{S), but Un^fiAn = N is external. 
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Example 26. Recall that a countably saturated enlargement U — > U' is an 
enlargement, where for each sequence (An)neN of internal sets with Ai D A2 ^ 
• • • D A,; D Ai^i 3 ••• we have HigN^* 7^ 0- If A € V is an algebra, then 
A* G U' is an algebra by transfer, hut not a a-algebra. 

Measures assign values in M := {—00} UMU {00}. 

20 The Loeb measure 

Let {D,,A,P) be an internal, finitely additive probability space, i.e. 

i) n internal 

ii) A is internal subalgebra of 7^(17) 

iii) P : ^ — > *R is an internal function such that 

iv) P (0) = 0, P (O) = 1, V A, B : P{A U B) ^ P{A) + P{B) - P{A n B). 

The following theorem is the main theorem of non standard probability theory. 

Theorem 27. There is a standard (a-additive) probability space {^IjAljPl) 
such that 

i) Al is a a-algebra with A C Al ^ 'Pi^) 
ii) Pl ^P° on a 

iii) For every A €z Al and standard e > there are Ai and Ao in A such that 
Aj C A C Ao and P {Ao \ A) < e 

iv) For every A e Al there is B e A such that Pl (AAB) = 

The space (fl, Al, Pl) is called a Loeb probability space 

Proof. We start with the finitely additive function P : A — s- [0, 00]*, where 
A is an internal ring of subsets of the internal set S. Then we set for all ^4 e A 

r sh(P(A)), if Pi (A) is limited 
Pl{A) = <^ (200) 
[ 00 else. 

We extend A to a cr-algebra by the standard outer measure construction. If 
i? C S is an arbitrary subset of S, then define 

Pl{B) = inf J ^ P{A„)\A„ e a and B C U„eNA„ i (201) 

[neti } 

A set S C 5* is called Loeb-measurable (P^ -measurable if it splits every set 
E C S Pi-additively in the sense that 

PLiE)^PLiEnB) + PL{E\B). (202) 

We define 

Al ■■= {A C S\A is Pl - measurable} (203) 
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From the standard outer measure construction we know that is a tj-algebra 
and Pl is a complete measure. We say that an arbitrary set B C 5 is called 
P-approximable if for every e > there exist approximating sets Ce,I?e G A, 
such that 

CeQB CD, and P {D, \C,) < e (204) 

First we show 

Lemma 28. If B is P-approximable then there exists a set A such that 

Pl (AAB) = 0. (205) 

We apply P-approximability and find two sequences of elements of .4 (Ci)jgf, 
and (A)jgN ■^ith 

• • • C C„ C C„+i C . . . C B C . . . C C Dn-i (206) 

and 

-PL(A^\A„)<- (207) 

n 

Recall that the embedding ?7 A L/' is sequentially comprehensive which means 
that any function f : N ^ B U* extends to an internal function / : N* — > 
B G U* . For each k £ N we have 

yneN* {n<k^CnCDkC D„) . (208) 

Since all constants are internal the latter statement is internal. Hence there 
exists K G N* \ N such that 

Vn G A/" : C„ C C D„ (209) 

holds. But then for all n G A/" we have 

DkAB = (Dk \B)U{B\ Dk) C a. \ Cn (210) 

and 

Pl{DkAB)<-. (211) 
n 

Hence Pl (Dk^B) = while Dk G A. Next we show: if B is Loeb measurable, 
then B is P-approximable. This follows from observation that for each Loeb- 
measurable set B we have 

Pl{B) = M{Pl{A)\B C a e A} 

= sup{Pl(A)|A C B&lA g A}. 
If (212) holds, then given e G K+ there are Ce,D, e A s. th. 

C.CBCD, ,Pi(A < Pl(P) + ^, and Pl{C,) < Pl{B) + |. (213) 
Then we get 

Pl(A\Q) =Pl{D,\B\JB\C,) 



(212) 



= Pl [D, \B) + Pl{B\ C) 

= Pl (A) - Pl (B) + Pl (B) - Pl (C,) 

< f + f - e> 



(214) 
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as desired. In order to prove (212) we first show that 

Ve G R+3A, eA:BCA^k Pl{A,) < Pl{B) + e. (215) 

Now, by the properties of outer measure for e > there exist a nondecreasing 
sequence (Ai)igN of elements of A with 

U,eN A,^B and Pl {yJ^enA^) < Pl{B) + e. (216) 

By sequential comprehensiveness, the sequence (yli)igN extends to a sequence 
(Ai)igN* of elements in A. For each fc S N we have 

fcfcVn e TV* (n < fc ^ A„ C Ak & P(A„) < Pl{B) + e) , (217) 

where we observed that P{An) ^ PiiAn) < PL(UigN)- The statement (??) 
is internal, so by overflow it must be true for some K E N* \ N in place of 
fc e N. Hence, A„ C Ak for aU n £ A/" and B C U„gN^n C Ak, while 
-Pl(^_r') ~ P{Ak) < Pl{B) + e, so Ak is the set A^ we are looking for. Next, 
to show that 

PL{B) = sn]){PL{A)\A(ZBkAeA} (218) 

means to show that given e G M+ there \s A^ <Z B with Pl{B) — e < Pl{A^). 
By the argument above there is D G A with BCD. Since I?, i? arc Loeb- 
measurable D\B is Loeb- measurable, so by the argument above there is C G ^ 
with D\B s.th. 

PLiC) <PLiD\B) + e. (219) 

W.l.o.g. CCD (otherwise replace C by C D). Let A, = D\C e A. Then 
A^ C B and C is the disjoint union oi D \ B and i? \ A,: . Hence, 

Pl{D \B)+PLiB\ A,) = PLiC) <Pl{B\ a,) < e. (220) 

Hence, 

PL{B)^PL{A,) + PL{B\A,)<PL{A,)+e, (221) 

so Pl{B) — e < PL(Ae), as desired. Next we prove: if B is P-approximable, 
then B is Loeb-measurable. We have to show that for P-approximable B and 
for all A C 5* 

PL{E)>PL{Er\B) + PL{E\B). (222) 
By Lemma (28) we have 

3A<aA: Pl{A/^B)^Q. (223) 

So 

PL{E)>PL{Ef^A) + PL{E\A). (224) 

Let C -.^ [E f^ B) \ A, D = [E r\ A)\B, C ^ E\{A\J B), !m& H = E r\ Af^ B . 
Then C C B \ A and D C A \ B. Hence, Pl(C) = Pl(£') = 0. Furthermore, 
C U H = E n B, while C n H = 0. Hence, 

Fl(-B nB) = PL{CUH)< PLiC) + Pl{H) = Pl{H), (225) 

and 

Pl{E \B)^Pl{DUC)< Pl{D) + PLiC) = Pl{G). (226) 
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Hence, 

Pl{E\B) + Pl{E\B) <Pl{H) + Pl[G) 

<PL{Er\A)+PL{E\A) (227) 
= Pl{E). □ 

21 Stochastic Integrals, It 6 formulas 

Definition of stocliastic integrals and proofs of Ito formulas are particularly 
simple in the nonstandard framework. Recall that an internal process is just an 
internal map 

X : O X T ^* M", (228) 

where {fl,J^,P) is an internal probability space. We may introduce stochastic 
integrals as follows: 

Definition 29. Let X : fl x T R and Y : D, x T ^* R be two internal 
processes. Then the internal process 

frdX ■.= Y.X{s,.)AY{s,.) (229) 

s<t 

is called a stochastic integral. Here, AY{t, .) ~ Y{t, .) — Y{t — At, .). 

Note that in nonstandard analysis an alternative way of defining martingales 
M = (Mf)t>o is to require 

/ AMt{uj)dP{uj) = (230) 

for all t > and all oj, and where M is an internal process. Recall that a 
martingale M is called a A^-martingale if E [Mj^] is finite for all t € T. Further- 
more recall that an internal process Y is called S'-continuous, if the internal map 
t — >■ Xtiio) is S'-continuous for almost all w. Here an internal map / : T — 
is S-continuous if for all s, t with s ^ t (i.e., s — t infinitesimal) we have 

- oo <° /(,s) =° fit) < oo. (231) 

Note that in non-standard analysis the quadratic variation of M can be defined 

by 

[M]t{n) = Y,^Ms{iof. (232) 

s<t 

Theorem 30. (Ito's formula) Let M he an internal process, which is a S- 

continuous -martingal, and assume that / : M — >■ M is twice continuously 
differentable. Then 

*f{Mt) /(A/o) + /o* *f{Ms)dAL + \ jl */"(M,)d[M], (233) 

Proof. From the nonstandard Taylor formula we compute the increment 

*/(M. + AMs) -* f{Ms) /'(M,)AM, + ^*f"AM^ 

(234) 

+i (/"AS2 - /"AM2) 
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for some between Mg and Ms + AMs. Summing up a telescopic sum leads 
to the result because the sum 

^ i (/"AS^ - /"AAf2) (235) 

is infinitesimal. ■ 



22 Proof of generalized Feyman-Kac formulas 
and generalized stochastic processes 

In this section we shall prove Feynman-Kac formulas for generalized Brownian 
motion. We also introduce generalized processes related to parabolic systems 
with variable coefficients. This is a first step in the direction of a stochastic 
field theory which may be worked out in the future. We have already seen that 
generalized Brownian motions can be defined on the same path space f2„ as the 
vectoriell Brownian motion, i.e., on the path space 

f}„ = {w : T ^ {-1, 1}" \uj internal } . (236) 

Recall that we defined an equivalence relation on il„ by 

w tD iff Vs < t : uj{s) ~ ti(s), (237) 

and denoted the corresponding equivalence classes by [w]". Furthermore, on 

f^M = {HLI'^eaJ, (238) 

we defined an internal probability measure 

(239) 

PUMW = 2^ for all ML e ^li- 

Let us consider the scalar case first, and how Feynman-Kac formulas can be 
proved in the framework of nonstandard analysis. For each time let us 
define the random variable 



Bf : r?" 



(240) 



Next recall that *Max denotes a hyperfinite discretization of *M with respect to 
the hyperreal number Az. In case of dimension n we define 

:= {/\xk\k C,* T-} , (241) 

where *Z denotes the set of hyperintegers and Axfc = (A.Tfci, • • • , Aa;fc„). Note 
that this discretization uses the same discretization size Aa; in all directions. 
This is sufficient since we are interested in projections to a classical space, 
and all classical objects we are interested in can be recovered by this form of 
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discretization. Note that for a considerable class of data / :* M" ^* R (see 
below) the standard part of the function 

u{tM,x) = E ifiB'tJ) = E / (KAKJ) PniKJ (242) 

satisfies the n dimension heat equation Cauchy problem with initial data ° f. We 
prove this using a nonstandard transition density (we could prove this directly, 
but the following considerations concerning the transition density are useful for 
our argument later on). Similar as in the case n = 1 in general dimension n > 1 
we introduce the density function p defined on T x * R^^ x * M^^ by 

p{tM,x,y):= ^?(SL(HL))^m(HL), (243) 

where for each y €* R^^ 

( 1 iff z = 2/ 

S^iz) := <^ (244) 
[ Oiffz^y 

denotes the hyperfinite n-dimensional Kronecker delta translated by y. The 
standard part of the function p can be computed as a limit similar as in the 
nonstandard proof of the central limit theorem above. Furthermore, the internal 
function u has a representation 

uitM,x)^ J2 E fiy)SU.KA[<J) PniMtJ, (245) 

and this representation may be used to get another proof of the Feynman-Kac 
formula for data in standard space. Let lit denote the projection Consider 
the 

p{tM + At,x,y) := EH?„^,enj,,, (sL,,(HL+j) nKi(HL+J 
= ^ + E.(t)e{-i.i}" T^U {^At)^) e,-Pr(w(i)) 

+ Ec^(t)e{-l,l}" Emp^^gOJ, ^'y (^tAl'"'*''^(MtM)) PMi[^]tM) 

= p{tM,x, 2/) + i Er=i £fPitM, X, y)At + O (At3/2) , 

(246) 

and this leads to the conclusion that the standard part of the function p satisfies 
the heat equation with respect to the variable x (heat equation with ^ times the 
Laplacian, to be precise). Similarly, the standard part of p satisfies the adjoint 
heat equation with respect to y (similar proof). Hence the standard part oi p 
is indeed the transition density. 

Next let us consider a parabolic system with constant coefficients a'^^, 6*^,, 
and Cj on the n torus T" = (R"/Z)" of the form 

{dui_ _ x^n ij d^Uj w duj_ i 

at - 2^j,k,l=l "-kl dxkdxi + l^3,k=l "jk dxk ~^ ^J = l S'^J' 
(247) 
Ui{0,x) = fi {0,x + ej) 
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for all ej and some data f = {fi, ■ ■ ■ , fn)'^ ■ For simplicity of notation we 
consider the case where the constants of the lower order terms are zero, i.e., 
6*^. = and = 0. We try to determine the solution in the form 

u(t,x)= Cait) cxp {i2Trax) , (248) 

where 

a(t) = (Ci(t),... ,C(t))^ (249) 
are vector-valued functions to be determined. Plugging (248) into (247) we get 

^ = - E 44^'«fc«;^^'. (250) 

j,k,l=l 

or, in matrix notation (with Aa ~ ) '■— (j2ki ^fc'i^Tr^afca;^ ), this is 

^ = (251) 
ot 

Since A is positive definite according to our assumptions we have 

Cait) = exp(-^„i)C„(0). (252) 

Moreover must be the ath Fourier coefficients fia (with respect to some 
order of multiindices) of the function fi, i.e., 

fia= fi{y) exp {~i27ray) dy (253) 
fi{x) ^ ^ /ia cxp (i27raa;) . (254) 



Let 

Hence, we have 



fa = (/al, ■ ■ ■ ,fan) ■ (255) 



\i{t,x) = 2_, / exp (— Afji) f (y) exp (i27ra(a; — 2/)) dy. (256) 
Next we define 

0^(t, .T - y) = EaGZ" exp (-A,<) exp {i2T:a{x - y)) , (257) 

where 

exp {i2TTa{x — y)) = (exp (i27ra(x' — y), • • • , exp (i27rQ;(a; — y))))"^ (258) 

Next recall that = Qa^aQa diagonal with positive entries Ai > 
and orthogonal Q. Hence, 

A^ ^ (QaA'J'QlQcA'J'Ql) = (QaA'J'Ql) ' (259) 
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Next define (with Ax = VAt) 
-.T X n„ - 



(260) 



where 5ij denotes the classical Kronecker S, and for a positive definite matrix 
A with decomposition QAQ^ and A = diag(Ai) define 



B 



Va 



T X Qr 



B^{t,iu) ■.^QB^"\t,uj)Q^. 



Then we have 



E 



E 



exp (iB^(t,.)) «cxp(-Ai), 
exp {iB^{t, .)) 1 - cxp {-At) 



(261) 



(262) 



(263) 



equals a matrix with infinitely small entries. Hence, we have the representation 



&^{t, x-y)^ E [exp (iaB^{t, .)) exp (i27ra(.T - y)) 



(264) 



Hence, we have the representation 

= Y.a&^ /t" '^^P {-^at) f (y) cxp (i27ra(x - y)) dy 



E 



cxp {iaB^{t, .)^ f (y) exp (i27rQ!(a; - y)) dy (265) 



= EaeZ"^ exp zaB^^°(t,.) fa 



The theorems (2) and (4) then follow by standard arguments. Next we consider 
systems with variable second order coefficients x — > a^iix). What we need for 
our construction is global existence and the requirement that for all 1 < i, j < n 
the matrices 



A^{x) = {A^^){x) :^ [Y^a'i^ix) 



(266) 
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arc uniformly elliptic in x G M" and for all a where all 7^ 0. In order to avoid 
technicalities we assume that for all a € Z" the functions x — >■ Aa{x) are C°°, 
bounded, and with bounded derivatives. We may consider the matrices in (266) 
on a hyperfinite lattice and use the same symbol A^ = Aa{x), where now 

X G* R^^,. For each a e Z" and each x S* consider the positive definite 
matrix ^0,(3;) with decomposition Aa{x) = Q'^A^Q'^'^ and A^, = diag(A2,i). 
Then define the increment 



T X f]. 



^Ax ' 



^Ax 



where 



AX^{t,u) := Q,AB^^'"{t,u)Ql , 
AB^"'\t,^) ^ EtiW^W%/Ate,VA^ 



(267) 



(268) 
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Then the a mode X''^ : T x n„ (g)* R"^^ of a generahzed process 

X'^'^{t, .) s may be defined by an internal sum of increments AX""^^. A gen- 
erahzed process is then given by 

.) := (exp (^laX^it, .))) (269) 

and can be used in order to set up a probabilistic scheme for parabolic systems 
with variable coefficients. 
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